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Abstract 

o 

■ A new channel coding approach was proposed in [1] for random muhiple access communication over the 



discrete-time memoryless channel. The coding approach allows users to choose their communication rates indepen- 
\ dently without sharing the rate information among each other or with the receiver. The receiver will either decode 

'nI" , the message or report a collision depending on whether reliable message recovery is possible. It was shown that, 

asymptotically as the codeword length goes to infinity, the set of communication rates supporting reliable message 
recovery can be characterized by an achievable region which equals Shannon's information rate region possibly 
Q , without a convex hull operation. In this paper, we derive achievable bounds on error probabilities, including the 

decoding error probability and the collision miss detection probability, of random multiple access systems with a 
^ ■ finite codeword length. Achievable error exponents are obtained by taking the codeword length to infinity. 

(N 

\^ . Index Terms 

• channel coding, error exponent, finite codeword length, random access 

I. Introduction 

^ ■ In multiple access communication, two or more users (transmitters) send messages to a common receiver. 

H ; 

f3 The transmitted messages confront distortion both from channel noise and from multi-user interference. 
Two related communication models, the multi-user information theoretic model and the random access 
model, have been intensively studied in the literature [2]. 

Information theoretic multiple access model, on one hand, assumes each user is backlogged with an 
infinite reservoir of traffic. Users should first jointly determine their codebooks and information rates, and 
then send the encoded messages to the receiver continuously over a long communication duration. The 
only responsibility of the receiver is to decode the messages with its best effort. Under these assumptions, 
channel capacity and coding theorems are proved by taking the codeword length to infinity [3] [4]. Rate and 
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error performance tradeoffs of single user and multiple access systems were analyzed in [5] [2]. Information 
theoretic model uses symbol-based statistics to characterize the communication channel. Such a physical 
layer channel model enables rigorous understandings about the impact of channel noise and multi-user 
interference. However, classical coding results have been derived under the assumption of coordinated 
communication, in the sense of joint codebook and information rate determination among the multiple 
users and the receiver. Such an assumption precludes the common scenarios of short messages and bursty 
traffic arrivals, since in these cases the overhead of full communication coordination is often expensive 
or infeasible. 

Random multiple access model, on the other hand, assumes bursty message arrivals. According to 
message availability, users independently encode their messages into packets and randomly send these 
packets to the receiver. It is often assumed that the transmitted packets should be correctly received if 
the power of the multi-user interference is below a threshold. Otherwise the receiver should report a 
packet collision and the involved packets are erased [6] [7]. Standard networking regards packet as the 
basic communication unit, and counts system throughput in packets per time slot as opposed to bits/nats 
per symbol. Communication channel is characterized using packet-based models, such as the collision 
channel model [8] and the multipacket-reception channel model [9] [10]. Although packet-based models 
are convenient for upper layer networking [12], their abstract forms essentially prevent an insightful 
understanding about the impact of physical layer communication to upper layer networking. 

In [1], a new channel coding approach was proposed for time-slotted random multiple access commu- 
nication over a discrete-time memoryless channel using a symbol-based physical layer channel model. 
Assume in each time slot, each user independently encodes an arbitrary number of data units into a packet 
and transmits the packet to the receiver. Define the normalized number of data units per symbol as the 
communication rate of a user in a time slot, which is shared neither among the users nor with the receiver. 
It was shown in [1] that, fundamental performance limitation of the random multiple access system can 
be characterized using an achievable rate region in the following sense. As the codeword length goes to 
infinity, if the random communication rate vector of the users happens to be inside the rate region, the 
receiver can decode all messages with zero asymptotic error probability; if the random communication rate 
vector happens to be outside the rate region, the receiver can detect a packet collision with an asymptotic 
probability of one. The achievable rate region was shown to equal to Shannon's information rate region, 
possibly without a convex hull operation. 

In this paper, we derive stronger versions of the coding theorems given in [1] by characterizing the 
achievable rate and error performance of random multiple access communication over a discrete-time 
memoryless channel with a finite codeword length. Our work is motivated by the existing non-asymptotic 
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channel coding results, surveyed in [13], for classical single-user communication. Following the framework 
of [1], we assume the random multiple access system predetermines an "operation region" of the rate 
vectors in the following sense. For all communication rate vectors within the region, the system intends to 
decode the messages; while for all communication rate vectors outside the region, the system intends 
to report a packet collision. Given the operation region, there are two types of error events. If the 
communication rate vector is within the region, the event that the receiver fails to decode the messages 
correctly is defined as a decoding error event. If the communication rate vector is outside the region, the 
event that the receiver fails to report a collision is defined as a collision miss detection event. An achievable 
bound on the system error probability, defined as the maximum of the decoding error probability and the 
collision miss detection probability, is obtained under the assumption of a finite codeword length. We 
show that, if the operation region is strictly contained in an achievable rate region, then the system error 
probability can decrease exponentially in the codeword length. The corresponding exponent is defined as 
the system error exponent, whose achievable bound is obtained from the error probability bound by taking 
the codeword length to infinity. 

The rest of the paper is organized as follows. With a practical definition of communicate rate, we 
investigate the error performance of singer-user and multi-user random access systems in Sections HI] and 
Hill respectively. The results are then extended in Section |IV] to systems with generalized random coding 
schemes using the standard communication rate definition, originally introduced in [1]. Further discussions 
and conclusions are provided in Section |Vl 

II. Rate and Error Performance of Single-user Random Access Communication 

For easy understanding, we will first consider single-user random access communication over a discrete- 
time memoryless channel. The channel is modeled by a conditional distribution function Py\x, where 
X E X,Y E y are the channel input and output symbols, X, y are the finite input and output alphabets, 
respectively. Assume time is partitioned into slots each equaling symbol durations, which is also the 
length of a packet. As in [1], we focus on coding within a time slot or a packet. 

Suppose the transmitter has no channel information except knowing the channel alphabetic. At the 
beginning of each time slot, according to message availability and the MAC layer protocol, the transmitter 
chooses a communication rate r E {^i, ■ ■ ■ , } without sharing this rate information with the receiver. 
Here {ri, ■ ■ ■ , tm} is a predetermined set of rates, in nats per symbol, with cardinality M, known by both 
the transmitter and the receiver. The transmitter then encodes [Nr\ data nats, denoted by a message w, 
into a codeword using a "random coding scheme" described as follows [l£ Let C = {Ce : e E &} he 

'The significance of tliis assumption will become clear when we investigate multi-user systems. 
^Note that the coding scheme is an extended version of the random coding introduced in [11]. 
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a library of codebooks indexed by a set 0. Each codebook contains M classes of codewords. The i*^ 
(z G {1, ■ ■ ■ , M}) codeword class contains [e^'^'J codewords, each of symbol length. Let Ce{w, r)j be the 
j*'* codeword symbol of message and communication rate pair {w, r) in codebook Ce, for j G {1, ■ ■ ■ , A^}. 
The transmitter first randomly generates 9 according to a distribution 7, such that random variables 
^{w,r),j ■ Cg{w,r)j are independently distributed according to an input distribution Px|J^- The 
random access codebook Cg is then used to map the message into a codeword. This is equivalent to 
mapping a message and rate pair (w, r) into a codeword, denoted by X(^w,r), of N channel input symbols. 

We assume the receiver knows the channel Py\x and the randomly generated codebook Cecl. Based 
on this information, the receiver chooses a rate subset IZ C {ri, - ■ ■ .tm}- According to the channel 
output symbol vector y, the receiver outputs an estimated message and rate pair [w, r) if and only if 
r E TZ and a predetermined decoding error probability requirement is satisfied. Otherwise the receiver 
outputs a collision. Note that the term "collision" here is used to maintain consistency with the networking 
terminology. Throughout the paper, collision means outage, irrespective whether it is caused by multi-user 
interference or by excessive channel noise. 

Since the receiver intends to decode all messages with r E TZ and to report collision for messages 
with r ^ TZ, we say TZ C {n, ■ ■ ■ , tm} is the "operation region" of the system. Conditioned on {w, r) is 
transmitted, for r E TZ, we define the decoding error probability as 

Pe{w,r) = Pr{{w,r) {w,r)\{w,r)}, W{w,r),r E TZ. (1) 

For r ^ TZ, we define the collision miss detection probability as 

Pc(«',r) = 1 - Pr{"collision"|(^i;,r)}, V(u), r), r ^ 7^. (2) 

Assume r < Ir{X;Y) for all r E TZ, where Ir{X;Y) is the mutual information between X and Y 
computed using input distribution Px\t- According to [1], we have the following asymptotic results, 

lim Pe(w,r) = 0, W(w,r),r E TZ, 

lim Pc(w,r) = 0, 'i{w,r),r ^TZ. (3) 

In other words, asymptotically, the receiver can reliably decode the message if the random communication 
rate r is inside the operation region; the receiver can reliably report a "collision" if r is outside the operation 
region. 

Equation (|3]) only gives the asymptotic limits on the error probabilities. In the rest of this section, we 
derive an achievable error probability bound under the assumption of finite codeword length A^. 

^We allow the input distribution to be a function of communication rate. In other words, codewords corresponding to different 

communication rates may be generated according to different input distributions. 

''This can be realized by sharing the codebook generation algorithm with the receiver. 
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Define the system error probability Pes as 



max < max Pe{w,r), max Pc{w,r) 



(4) 



The following theorem gives an achievable upper bound on Pes- 

Theorem 1: Consider single-user random access communication over discrete-time memoryless chan- 
nel Py\x- Assume random coding with input distributions Px\r, defined for all r G {ri, ■ ■ ■ ,rM}- Let 
^ ^ {^1, ■ ■ ■ iT^m} be an operation region. Given a codeword length A^, there exists a decoder whose 
system error probability P^s is upper bounded by 

J2fen exp{-NEmif, Px\r, Px\f)} + iaaXf^T^exp{-NEi{r, Px\r, Px\f)} , 



Pp, < max 



max^eT^ 



J2ren maxjr^T^ exp{-NEi{r, Px\r, Px\f)} 
where Emir, Px\r, Px\f) and Ei{r, Px\r, Px\f) are given by 



(5) 



Em{r,Pxi 



Px\r) 



max — pr + max 

0</3<l 0<s<^ 



Y 



Ei{r, Px\r, ^x\f 



Pxif.) = max —pr+ max — lo£ry^ 

- 0<s<l-p V 



X 



0<p<l 

Y^Pxi,{X)PiY\X) 



j:Pxir{x)PiY\xr 

X 

Y^PxiriX)PiY\X)^. 



X 



J2Px\,{X)P{Y\X)i 

. X 

s+p 



X 



1-S 



(6) 



The proof of Theorem [H is given in Appendix In the proof, we assumed the following decoding 
algorithm at the receiver to achieve the error probability bound given in ([5]). Upon receiving the channel 
output symbols y, the receiver outputs an estimated message and rate pair {w,r) with r G 7^ if both the 
following two conditions are satisfied, 



CI: - -^\ogPr{y\x(^^.r)} < -^\ogPr{y\x(^^^f)} , for all (w, r) ^ {w,r),r,r e 7^, 
C2: - ^ log Pr{y\xi^^^r)} < rr{y)., 



(7) 



where Tr{-) is a pre-determined function of the channel output y, associated with codewords of rate r. 
We term Tr{-) a typicality threshold function. If there is no codeword satisfying (|7]), the receiver reports 
a collision. In other words, the receiver decodes only if the log-likelihood of the maximum likelihood 
estimation exceeds certain threshold. Note that the random access codebook used to encode the message 
contains a large number of codewords, but the receiver only searches codewords corresponding to rates 
inside the operation region. 

^Even though Theorem [T] is implied by Theorem |2] given in Section [nil we still provide its full proof because it is much easier to follow 
than the proof of Theorem |2] Indeed, we suggest readers should understand the basic ideas in the proof of Theorem [T] before reading the 
more sophisticated proof of Theorem |2] 
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Define the corresponding exponent as the system error exponent Es = lim^v^oo —jf^ogP^s- Theorem 
[T] implies the following achievable bound on Eg. 

Corollary 1: The system error exponent of single-user random access communication given in Theorem 
\T\ is lower-bounded by 

Es = lim log Pes > min ( min E„(f, Px\r, Px\f), min^ Ei{r, Px\r, Px\f)\ , (8) 

where Em{f, Px\r-, Px\f) and Ei{r, Px\r, Px\f) are defined in ■ 

Corollary [T] is implied by Theorem [U An alternative proof can also be found in [14]. 

Note that if we define the decoding error exponent E^ and the collision miss detection exponent E^. as 

Ed= ^ inin lim -\-\ogPe{w,r), 

Ef, = min lim log Pc(w,r), (9) 

then the system error exponent equals the minimum of the two exponents, i.e., Eg = mm{Ed, Ec}. The 
lower bound of Eg given in ([8]) is obtained by optimizing the typicality threshold function Tr{-) as done 
in the proof of Theorem [TJ It is easy to see that, for each y, the decoding error exponent Ed increases in 
Triy), while the collision miss detection exponent E^ decreases in Tj.{y). Therefore, Tr{-) can be used to 
adjust the tradeoff between Ed and Ec. 

Also note that the first term on the right hand side of ([8]) corresponds to the maximum likelihood 
decoding criterion CI in (|7]). This term becomes Gallager's random-coding exponent [5] if the input 
distributions associated to all rates are identical. The second term is due to the typical sequence decoding 
criterion C2 in (|7]). The two criteria, in conjunction, enabled collision detection at the receiver with a 
good decoding error performance. 

We end this section by pointing out that the probability bound given in ([5]) can be further tightened, 
especially when the input distributions corresponding to r G 7^ are similar to each other. In the special 
case if the input distributions are identical for all rates, then the term Y.f&n GW{~^Em{f, Px\r, Px\f)} in 
([5]), which corresponds to the maximum likelihood decoding criterion CI in (|7]), can be further improved 
to Gallager's bound given in [sj^ However, in a general case, such improvement makes the error bound 
less structured comparing to Q, and it gives the same error exponent results. Therefore, we choose to 
skip the detailed discussion in the paper. 

III. Rate and Error Performance of Random Multiple Access Communication 

In this section, we consider K-user time-slotted random multiple access communication over a discrete- 
time memoryless channel. The channel is modeled by a conditional distribution Py\Xi,---,Xk^ where E 

^Specifically, we mean the bound given by (18) in [5] with R = log X^^g^ e'^^. 
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Xk, k e {1, • • • , K}, is the channel input symbol of user k with being the the finite input alphabet, 
and Y e y is the channel output symbol with y being the finite output alphabet. Assume the slot length 
equals symbol durations, which is also the length of a packet. We again focus on coding within one 
time slot. 

Suppose at the beginning of a time slot, each user, say user k, chooses an arbitrary communication 
rate r^, in nats per symbol, and encodes [Nrk\ data nats, denoted by a message Wk, into a packet of 
N symbols. Assume rk e {r^i, • • • , rjtj^^}, where {rki, - - - ifku} is a predetermined set of rates, with 
cardinality M, known at the receiver. We assume the actual communication rates of the users are shared 
neither among each other, nor with the receiver. Whether the channel is known at the users (transmitters) is 
not important at this point. Because the global rate information is not available, an individual user cannot 
know a priori whether or not its rate is supported by the channel in terms of reliable message recovery. 
Encoding is done using a random coding scheme described as follows. Let Ck — {Cko^. ■ Ok e Ok} be a 
codebook library of user k, the codebooks of which are indexed by set O^. Each codebook contains M 
classes of codewords. The i*'* codeword class contains [e^'''=ij codewords, each with A'^ symbols. Denote 
Cfc6»fc(^tJfe, rfe)j as the symbol of the codeword corresponding to message Wk and communication rate 
Tfe in codebook C^e^.. User k first generates 9^ according to a distribution 7^., such that random variables 
^{wk,rk),j '■ — ^ Ck0^{wk,rk)j are independently distributed according to an input distribution Px\rk - User 
k then uses codebook Cke^. to map {wk,rk) into a codeword, denoted by iE(M,fc,r-fc)> and sends it to the 
receiver. 

Assume the receiver knows the channel Py\Xi,-,Xk the randomly generated codebooks of all 
users. Based on the channel and the codebook information, the receiver predetermines an "operation 
region" TZ, which is a set of communication rate vectors under which the receiver intends to decode the 
messages. In each time slot, upon receiving the channel output symbol vector y, the receiver outputs the 
estimated message and rate vector pair {w, r) (that contains the estimates for all users) only if f e 7?. 
and a predetermined decoding error probability requirement is satisfied. Otherwise the receiver outputs a 
collision. 

To simplify the notations, we will use bold font vector variables to denote the corresponding variables of 
multiple users. For example, w denotes the message estimates of all users, r denotes the communication 
rates of all users, Px\r denotes the input distributions conditioned on communication rates r, etc. For a 
vector variable r, we will use to denote the element corresponding to user k. Let 5 C {1, ■ ■ ■ , K} be 
an arbitrary subset of user indices. We will use rs to denote the communication rates of users in S, and 
will use Ws to denote the messages of users not in S, etc. 

Similar to the single-user system, conditioned on {w,r) is transmitted, we define the decoding error 
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probability for {w, r) with r eTZ as 

Pe{w,r) = Pr{{w,r) ^ (io,r")|(ii?,r)}, V(ii?,r"),r e V.. 
We define the collision miss detection probabilities for (ly, r) with r ^ 7?. as 

Pjyw.r) = 1 - Pr{"collision"|(to,r)},V(t«,r),r ^ 7^. 



(10) 



(11) 



Assume for all r G 7^ and for all user subset 5 C {1, • • ■ , /C}, we have Y^k^s^'k < Ir{Xg] Y\Xs), 
where Ir{X§]Y\Xs) is the conditional mutual information computed using input distribution Px\r- 
According to the achievable region result given in [1], asymptotically, the receiver can reliably decode 
the messages for all rate vectors inside TZ and can reliably report a collision for all rate vectors outside 
TZ. In other words. 



lim Pe{w, r) = 0, V(ty, r),r 

N—^oo 

lim Pc{w,r)—0^ V(ty, r), r ^ 7?.. 



Define the system error probability Pes as 



Pes = max < max Pe{w,r), max Pc{w,r) 

I {w,r),r&'R, {w,r),r^'R- 



(12) 



(13) 



The following theorem gives an upper bound on Pes. 

Theorem 2: For X-user random multiple access communication over a discrete time memoryless 
channel Py\x- Assume finite codeword length N, and random coding with input distribution Px\r for 
all r with rk e {r^j, ■ ■ ■ ,rfc^^}, 1 < A < K. Let TZ be the operation region. There exists a decoding 
algorithm, whose system error probability Pes is upper bounded by 

"I > 

J2reTZ,fs=rs exp{-NEm{S, r, Px\r, Px\f)} 

+ mSiKr'^-R,r'^=rs^W{-NEi(S,r,Px\r,Px\r')} ^ (14) 

_ maxf^T^ J2sc{i,-,K} Ere7^,rs=f•s ma:Xr'^n,r's=rs exp{-NEi{S, r, Px\r, Px\r')} 
where E^{S,r, Px\r, Px\r) and Ei{S,r, Px\r, Px\r') are given by 

ErniS, r, Px\r, Px\r) = max -pJ2h+ max - log ^ ^ H Px\rki^k) 



Pes < max < 



max^gT^ J2sc{i,-,K} 



k^S 



Y XskeS 



X I E n Px\r,{X,)P{Y\Xy-^ Px\,,{X,)P{Y\X) 

yXgk^S J \Xgk^S 

Ei{S, r, Px\r, Px\r') = m^ -P E + nj^l?i " E E 11 Px\r,{Xk) 

k^S " - Y XskeS 

\ s+p I \ 1-s 

X I E n PxvAXk)P{Y\X)-^A W n Pxv',{X^)P{y\X) 



(15) 



^Xs kiS 



\Xs k^S 
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The proof of Theorem [2] is given in Appendix |Bl In the proof, we assumed the following decoding 
algorithm at the receiver to achieve the error probability bound given in (fT4l) . Upon receiving the channel 
output symbols y, the receiver outputs an estimated message vector and rate vector pair {w, r) with r E TZ 
if both the following two conditions are satisfied. 

CI: - ^\ogPr{y\x(^^r)} < - ^ log Pr{y\x^^^f)}, for all {w,r) ^ {w,r),r,r e 7^, 

C2: - ^\ogPr{y\x^^^r)} <Tr{y), (16) 

where Tr{-) is a pre-determined typicality threshold function of the channel output y, associated with 
codewords of rate r. If there is no codeword satisfying (fT6l ). the receiver reports a collision. 

Define the corresponding exponent as the system error exponent Eg = limAr_i.oo — ;^ log -Pes- Theorem 
|2] implies the following achievable bound on E^. 

Corollary 2: The system error exponent of single-user random access communication given in Theorem 
|2] is lower-bounded by 

Es>mm\ min min E^{S,r, Px\r, Px\r), min ^ min Ei{S,r, Px\r, Px\r)\ , 

(17) 

where Em{S, r, Px\r, Px\r) and Ei{S, r, Px\r, Px\r) are defined in (flSl) . ■ 
Corollary [21 is implied by Theorem [21 

As in the single-user system, if we define the decoding error exponent E^ and the collision miss 
detection exponent E^. as 

Ed= min lim XogPeiw.r), 

Er = min lim —— log PJw , r) , (18) 

then the system error exponent equals the minimum of the two exponents, i.e., Es = mm{Ed, Ec}. Again, 
instead of optimizing the typicality function r^(-) to lower bound Eg, rr{-) can be used to adjust the 
tradeoff between Ed and Ec. 

Note that, in Theorem [2l the receiver either decodes the messages of all users or reports a collision for 
all users. In practice, the receiver could choose to output message estimates for a subset of users and to 
report collision for the others. The corresponding achievable communication rate region has been given 
in [1]. An error performance bound can be derived using an approach similar to the one shown in the 
proof of Theorem [21 The detailed analysis, however, is skipped. 
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IV. Error Performance under Generalized Random Coding with Standard 

Communication Rate 

In the previous sections, we used the practical definition of communication rate, i.e., communication rate 
equals the normalized data nats per symbol encoded in a packet. Codewords of each user are partitioned 
into M classes each corresponding to a rate option. This is equivalent to indexing the codewords using 
a message and rate pair {w,r). We assumed codeword symbols within each class, i.e., corresponding to 
the same r, should be randomly generated according to the same input distribution. In this section, we 
extend the results to the generalized random coding scheme [1] where symbols of different codewords, 
as opposed to different codeword classes, can be generated according to different input distributions. 

We will index the codewords in a codebook using a macro message W, which is essentially another 
expression of the {w,r) pair used in previous sections. In other words, W contains both information 
about the message w and the rate r in practical senses. The generalized random coding scheme is defined 
originally in [1] as follows. 

Definition 1: (generalized random coding [1]) Let C = {Cq : 6 E Q} he, ^. library of codebooks. Each 
codebook in the library contains e^^"'*'' codewords of length N, where i?max is an arbitrary large finite 
constant. Let the codebooks be indexed by a set 0. Let the actual codebook chosen by the transmitter 
be Ce where the index 6* is a random variable following distribution 7. Let W e {1, • • • , e^^'"^='} be a 
macro message used to index the codewords in each codebook. Denote C0(W)j as the j^^ symbol of 
the codeword corresponding to macro message W in codebook Ce- We define {C,^) as a generalized 
random coding scheme following distribution Px\w^ if the random variables Xw,j '■ C0{W)j, Vj, W, 
are independently distributed according to input distribution Px\w- ■ 

Note that a generalized random coding scheme allows codeword symbols corresponding to different 
messages to be generated according to different input distributions. Because codewords are indexed 
using macro message W, communication rate r becomes a function of W. Consequently, the practical 
communication rate r used in previous sections only represents a specific choice of the rate function. In 
order to distinguish codewords from each other in rate and error performance characterization, in this 
section, we will switch to the following standard communication rate definition, originally introduced in 
[1]. 

Definition 2: (standard communication rate [1]) Assume codebook C has e^^™^ codewords of length 
N, where Rmax is an arbitrary large finite constant. Let the corresponding messages or codewords be 
indexed by W e {1, • • • , e^^™*^}. For each message W, we define its standard communication rate, in 
nats per symbol, as r{W) — log W. ■ 

Since the standard rate function r{W) — log W is invertible, system performance characterized in 
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any other rate function can be derived from that of the standard rate function [ij^. 

The following definition specifies a sequence of generalized random coding schemes following an 
asymptotic input distribution. 

Definition 3: (asymptotic input distribution [1]) Let {{C^^\'y^^^)} be a sequence of random coding 
schemes, where {C^^\'y^^'>) is a generalized random coding scheme with codeword length N and input 
distribution P^^^(n)- Assume each codebook in library C^^^ has e^^™'''' codewords. Let Px\r be an input 
distribution defined as a function of the standard rate r, for all r G [0,i?niax]- We say {(£*^^\ 7^^^)} 
follows an asymptotic input distribution Px\r, if for all {W'-^''} sequences with well defined rate limit 
lim]\f^aor{W'^^^), we have 

Note that since we do not assume Px\r is continuous in r, we may not have Muin^oo Px\riw<^^'i) = 

-Pjfllimjv^^rCWW)- ■ 

Let us still use bold font vector variables to denote the corresponding variables of multiple users. 
Theorem [3] gives the achievable error exponent of a random multiple access system using generalized 
random coding. 

Theorem 3: Consider K-user random multiple access communication over a discrete-time memo- 
ryless channel Py\x using a sequence of generalized random coding schemes {{C^'^\^^^^)}. Assume 
{{C^^\^''^^)} follows asymptotic distribution Px\r- For any user k, assume Pxk\rk i^ o'^iy discontinuous 
in Tk at a finite number of points. Let the operation region TZ be strictly contained in an achievable rate 
region, specified in [1]. Equation (flTl) gives an achievable lower bound on the system error exponent Es, 
with rates in the equation being the standard communication rates. ■ 

The proof of Theorem [3] is given in Appendix O In the proof, an achievable error probability bound 
in the case of a finite codeword length is also given in Lemma \\\ 

V. Conclusions 

We investigated the error performance of a new coding scheme for random access communication 
over discrete-time memoryless channels. Two types of error events are considered, the decoding error 
event when the transmitted communication rate vector is inside the operation region, and the collision 
miss detection event when the transmitted communication rate vector is outside the operation region. 
Upper bound on the system error probability, defined as the maximum probability of both error events, 
is derived for both single-user random access and random multiple access communication systems with 
a finite codeword length. We showed that, if the operation region is strictly contained in an achievable 

'Note that the standard rate is defined using the natural log in this paper, while it was defined using the base-2 log in [1]. 
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rate region, then the system error probability can decrease exponentially in the codeword length. An 
achievable lower bound on the system error exponent is obtained. The result is also extended to random 
multiple access communication systems using generalized random coding with standard communication 
rate definition. 

Appendix 

A. Proof of Theorem [7] 

Proof: To derive the system error probability upper bound, we assume the receiver uses the decoding 
algorithm whose decoding criteria are specified in (|7]). 

We next define three probability terms that will be extensively used in the probability bound derivation. 

Fist, assume {w,r) is the transmitted message and rate pair with r E TZ. We define Pm[r,f] as the 
probability that the receiver finds another codeword with rate f ElZ that has a likelihood value no worse 
than the transmitted codeword. 

-PmM = Pr [P{y\x(^^^r)) < P{y\x(^^^f))} , {w, r) {w,r),r E TZ. (20) 

Second, assume (w, r) is the transmitted message and rate pair with r E TZ. We define Ptr as the 
probability that the likelihood of the transmitted codeword is below a predetermined threshold. 

Ptr = Pr {P{y\x^^,r)) < e-^^--^^)} , (21) 

where Tr{y) is a threshold, as a function of r and y, that will be optimized latec. 

Third, assume (w, f) is the transmitted message and rate pair with f ^ IZ. We define Pi[f,r] as the 
probability that the receiver finds another codeword with rate r E TZ that has a likelihood value above the 
required threshold. 

P,[f,r] = Pr {Piy\x^^,r)) > e-^^^(^)} , («;,r) ^ {w,r).,r E TZ. (22) 
With these probability definitions, we can upper bound the system error probability Pes by 

Pes < max <^ max V Fm[r,f] + Ptr, max V Pi[f,r] \ ■ (23) 



Next, we will upper bound each of the probability terms on the right hand side of (1231) . 
Step 1: Upper-bounding Pm[r,f]- 

*Note that the subscript r of rr{y) represents the corresponding estimated rate of the receiver output. Although with an abuse of the 
notation, we occasionally use the same symbol r to denote both the transmitted rate and the corresponding rate estimation at the receiver, 
it is important to note that we do not assume the receiver should know the transmitted rate. 
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Assume {w,r) is the transmitted message and rate pair with r e TZ. Given r,r e TZ, Pm[r,f] can be 
written as 



Y,P{y\X[w,r))<Pm[r,f]{y) 



(24) 



where (t)m[r,f]{y) = 1 if P{y\xi^^^r)) < P{y\x(^^^f)) for some {w,r) ^ {w,r), and (f)m[r,f]iy) = otherwise. 
Revised from Gallager's approach [5], for any p > and s > 0, we can bound 0m[r,f](2/) by 



<Pm[r,f]{y) < 



Piy\X(^u,,r))' 



p > 0, s > 0. 



(25) 



Consequently, Pm[r,f] is upper bounded by 



Pm[r,f] < Eg 



Ea 



J2Piy\Xin^,r)) 

y 



E 



Piylx^^^r))" 

J2 P{y\x(u,,f)y' 



J2Ee\P{y\x^^,r)y- 



Eo 



J2 P{y\x[^,f)Y' 



(26) 



where in the last step, we can separate the expectation operations due to independence between X(^yj^j.) 
and X{w,f)- 

Now assume < p < 1. Inequality (|26l ) can be further bounded by 



PmW^f] 

< ^Eg\P{y\X(^^^r)Y' 



Eo 



Y,P{y\x{w,f)y> 



^ PI 



< 



e^pfJ^Ee [P(y|x(^,,,))i-^] [Ee [Piylx^^^,))' 



,Npf 



E 

> Y 



Y^P^\^{X)P{Y\Xf- 
. X 



j2Px\,{x)p{Y\xy. 

J L X 



TV 



(27) 



Since (1271) holds for all < p < 1, s > 0, and it is easy to verify that the bound becomes trivial for 
s > 1, we have 



f] < exp [-NE^{r, Px\r, Px\f 



(28) 



where E^^{r, Px\r, Px\f) is given by 
Em{r,Px\v,Px\f) = max -pf + max -logV 

0<p<l 0<s<l •TT 



j:PxiriX)PiY\X) 
. x 



1-s 



J2Pxi,iX)PiY\X)f 
. X 



(29) 



Step 2: Upper-bounding Pfr. 

Assume {w,r) is the transmitted message and rate pair with r e TZ. Rewrite Ptr as 



Ptr — Eg 



Y,P{y\X(yj,r))(l)tr{y) 



(30) 



14 



where (ptriv) = 1 if P(t/|a;(^ ,.)) < e~^'^''^y\ otherwise 4>tr{y) = 0. Note that the value of T.f.{y) will be 
specified later. 

For any si > 0, we can bound (ptr{y) as 



^tr{y) < —, Si > 0. 



(31) 



This yields 



Ptr < Eo 



1-Sl -NsiTriu) 



I V 



Y,Ee[P{y\x(u,,r)f- 



-NsiTriy) 



(32) 



We will come back to this inequality later when we optimize r,.( y). 
Step 3: Upper-bounding Pi[f^r]- 

Assume {w,f) is the transmitted message and rate pair with f ^ TZ. Given r E TZ, we first rewrite 



Pi\f r] as 



P^ff r] — Ea 



Y,P{y\x{w,f))(t>i[f,r]{y) 



(33) 



where (j)i[f,r]{y) = 1 if there exists (w,r) with r G 7^ to satisfy P(?/|a3(„, ,.)) > e ^'^^^y\ otherwise 

(t)t[f,r]{y) = 0. 

For any S2 > and p > 0, we can bound (/>i[f,r](l/) by 



(Pi[f,r]{y) < 



EwP{y\X{nj,r)) ^ 



, S2>0,p>0. 



(34) 



This gives, 



Pi.\f,r] ^ El 



J2P{y\X(u,,f)) 
V 

Y^Ee \P{y\x^ii,^f)) 



Y,P{y\X(^,r)) ^ 

Y,P{y\x(,,,r)P 



Ns2Tr{v) 



E, 



^Ns2Tr{y) 



(35) 



Note that we can separate the expectation operators in the last step due to independence between X(^y^^r) 

and X(^w,f)- 

Assume < p < 1. Inequality (|35]) leads to 

tJe [^{y\x^^^f))\ [Ee [^{y\X(^^^r)) ^ J 

y 



Pi[f,r] < J2^e[P{y\x(^u,,f)) Ee P{y\x(^^^r)) 



^Ns2Tr{y)^Npr 



< 



^J^H^e \P{y\x(^^^f))] {Ee \P{y\x(^^^r)) ^'1 } e 



^Ns2Tr{y)pNpr 



(36) 



Note that the bound obtained in the last step is no longer a function of f. 
Step 4: Choosing Tr{y). 
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In this step, we determine the typicality threshold Tr{y) that optimizes the bounds in (|32l ) and (|361 ). 
Let us define f* 7^ as 



(37) 



f<^n y 

Given r E 71, y, and the auxiliary variables si > 0, S2 > 0, < p < 1, we choose Tr{y) such that the 
following equality holds, 



Eg 



P{y\x(^^,r)y-'^] e-^^i^^(^) = Ee [f(2/|x(^,,.))] {Ee ] }' e 



Ns2Tr(y) N pr 



(38) 



This is always possible since the left hand side of (l38l) decreases in Tr{y) while the right hand side of 
(l38l) increases in Tr{y). 
Equation (|38] ) implies 



TV— £— r 

S1+S2 



[Ee[P{y\x(^,r)Y-^-]y' 



(39) 



+=2 



Substituting ([391) into ([321) yields 



SIP 



Let S2 < p and si = 1 — ^. Inequality (|40l) becomes 



Ptr <Y.{Ee [P(y|a;(^,,))f {i?, [P(?/|a;(^,,.))] }^"^^ e 



p-(l-p)s2 



(40) 



(41) 



Now do a variable change with p = p^^l^J^-^^^ and s = 1 — jz^^zfjj^^ and note that s + p < 1. Inequality 
(|4T]) becomes 



Ptr < Y.{^(>[^(y\^i^,r))'+^]y^^ {Ee[Piy\x^^.r*))]y ' e 



1-s 



,Npr 



< max < 



-| s+p r 



EPx|.(x)P(r|x)^ 



j:PMx)PiY\x) 

L X 



1-s 



TV 



^Npr 



(42) 



Following the same derivation, we can see that Pj[f,r] is also upper-bounded by the right hand side of 
|42)) . Because (|42l) holds for all < p < 1 and < s < 1 - p, we have 



Ptr, Pilf,r] < m.axexp{-NEi{r, Px\r, Px\f)}, 

r0i 



where 



Eiir, Px\r, Px\f) = max —pr+ max 

' ' 0<p<l 0<s<l-p 

Finally, substituting (l28l) and (l43l) into (|23l) gives the desired result. 



ax -logE 



J2PxiriX)PiY\X)^p 

X 



s+p 



J2Px\,{X)P{Y\X) 



X 



(43) 



1-s 



(44) 
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B. Proof of Theorem 

Proof: Due to the involvement of multiple users, notations used in this proof are rather complicated. 
To make the proof easy to follow, we carefully organize the derivations according to the same structure 
as the proof of Theorem [U Because Theorem [T] is indeed a simplified single-user version of Theorem [21 
it will help significantly if the reader follows the proof of Theorem [2] by comparing it, step by step, to 
the proof of Theorem [T] 

We assume the receiver uses the decoding algorithm whose decoding criteria are specified in (fT6l) . 
However, to facilitate the derivation, we first need to make a minor revision to the decoding rules. 

Given the received channel symbols y, the receiver outputs a message and rate vector pair {w,r), with 
r G 7^, if for all user subsets 5 C {1, ■ ■ • , K}, the following two conditions are met. 

CIR: - ^\ogPr{y\x(^^r)} < log Pr{j/|a[;(^,f)}, 

for all {w,r) with r eTZ, {ws,rs) = {ws,rs), and {wk,fk) 7^ {wk,rk),yk ^ S, 
C2R: - ^\ogPr{y\x(^^r)} <r(r,s){y)- (45) 

Note that in Condition CIR, we added the requirements of (ws, f^) = {ws, r^) and {wk, fk) 7^ {wk, rk), 
VA; ^ S. The union of Conditions CIR over all user subsets 5 C {1, ■ ■ ■ , K} gives Condition CI in (fT6l) . 
In Condition C2R, we assume the typicality threshold T(^r,s)iy) depends on both r and S. By taking the 
union over S C {1, ■ ■ ■ , K}, Condition C2R in (l45l) implies that the typicality threshold in Condition 
C2 of (fT6l) should be set at Tr{y) = min^cii, --,/^} ''"(r,5)(?/)- In the rest of the proof, we will analyze the 
probabilities and optimize the thresholds T(^r,s)iy) separately for different S. 

Given a user subset S C {1, ■ ■ ■ , K}, we define the following three probability terms that will be 
extensively used in the probability bound derivation. 

First, assume {w, r) is the transmitted message and rate pair with r E TZ. We define Pm[r,r,s] as the 
probability that the receiver finds another message and rate pair (w, r) with r E TZ, {ws, rs) = {ws, r^), 
and {wk, fk) 7^ ("Wk, rk)yk ^ S, that has a likelihood value no worse than the transmitted codeword. 

Pm[r,r,S] = Pr [Piy\X(^^^r)) < P{y\X(^^^f))] , 

{w,r),r E 7^, {ws,rs) = {ws,rs), iwk,fk) ^ {wk,rk),'ik ^ S. (46) 

Second, assume {w, r) is the transmitted message and rate pair with r E TZ. We define Pt[r,s] as the 
probability that the likelihood of the transmitted codeword is no larger than the predetermined threshold 

nr,s){y)- 

Ptir,s] = Pr {P{y\x^^,r)) < e-^^(-^)(^)} , (47) 
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(48) 



where the threshold T(^r,s){y) will be optimized latec. 

Third, assume (w,?") is the transmitted message and rate pair with r ^ IZ. We define Pi[r,r,s] the 
probability that the receiver finds another message and rate pair {w, r) with r E TZ, (ws, r^) = (ws, f^), 
and {wk,rk) ^ {wk,fk),yk ^ S, that has a likelihood value above the required threshold r(r,s)iy)- 

{w,r),r e TZ, {ws,rs) = {ws,rs), {wk,rk) 7^ {wk,fk)yk ^ S. 
With these probability definitions, we can upper bound the system error probability Pes by 

maX^gT^ X)5C{1,- -,^} ^r&-R,rs=rs ^rn[r,r,S] + Pt[r,S] 
maXr^Tl J2sc{l,- -,K} '^ren,rs=rs ^i[f,r,S] 

Next, we will upper bound each of the probability terms on the right hand side of (I491 ). 
Step 1: Upper-bounding Pm[r,r,s]- 

Assume {w, r) is the transmitted message and rate pair with r eTZ. Given r,r eTZ, Pm[r,r,s] can be 
written as 



Pp, < max 



(49) 



P 



'm[r,r,S] — 



Piy\X{w,r))4>m[r,r,S] iv) 



I V 



(50) 



where (i)m[r,r,s]{y) = 1 if P{y\xi^^^r)) < P{y\x(ii,,r)) foT somc {w,r), with {ws,rs) = {ws,rs), and 
{wk.fk) 7^ {wk,rk),\/k ^ S. (j)m[r,r,s]iy) = ^ otherwisc. 
For any p > and s > 0, we can bound (pm[r,f,s]iy) by 



4'm[r,r,S]iy) < 



P{y\X{^u,r))>' 

Consequently, Pm[r,r,s] is upper bounded by 



, p>0,s>0. (51) 



Pm[r,r,S] ^ E( 



EEs 



y 



J2P{y\X(n,,r) 

y 

P{y\x{^^r)y-' 



P{y\X(^^^r)] 



P{y\X{n,,r)] 



J2 P{y\x(ii,,f)] 

. lw,{ws,rs)={ws,rs),{wk,fk)¥=iwk,rk)yk^S 



(52) 



where in the last step, we can take the expectations operations over users not in S due to independence 
between the codewords of {w§,r§) and {w§,rg). 

'As in the single-user case, the subscript r of T(^,5)(j/) represents the corresponding estimated rate of the receiver output. Note that we 
do not assume the receiver should know the transmitted rate. 
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Now assume < p < 1 . Inequality (|52l ) can be further bounded by 



m[r,r,S] 



0s 



Ee, [P{y\ 



X 



(io,r) 



vl-s 



Ea 



E ^(?/|a^(*,r))' 

w,{'ws,rs)={ws,rs) 



(53) 



Since (1531) holds for all < p < 1, s > 0, and it is easy to verify that the bound becomes trivial for 
s > 1, we have 

^'m[r,r,5] < [- N E„,{S , T , P x\r , P X\r)} , (54) 

where Em{S, r, Px\r, Px\r) is given by 

E^{S, r, Px\v, Px\r) = max -pJ2^k+ max - log^ E 11 Pxini^k) 

k^S °- Y XskeS 



E n PxH{Xk)p{Y\xy-^ m: n Pxi,,{x,)p{Y\xy, 

yX^k^S J \X^k<^S 

Step 2: Upper-bounding Pt[r,5]- 

Assume (w, r) is the transmitted message and rate pair with r E TZ. Rewrite Pt[r,s] as 



(55) 



Pt[r,s] = Ee 



J2 P{y\X{n,,r))(l)t[r,S]{y) 



(56) 



where (pt[r,s]iy) = 1 if P{y\x(^w^r)) < e~^'^(''''S)(2^), otherwise (j)t[r,s]iy) = 0. Note that the value of 
T{r,s)iy) "wiU be specified later. 

For any si > 0, we can bound (j)t[r,s]{y) as 



g-AfSlT(^_5)(j/) 



(57) 



This yields 



Pt[r,S] < 



-Afsir(^_5)(2/) 



(58) 



We will come back to this inequality later when we optimize T(^r,s)iy)- 
Step 3: Upper-bounding Pi[r^r,s]- 

Assume (w^r) is the transmitted message and rate pair with f ^ TZ. Given r E TZ, we first rewrite 

Pi[f,r,s] as 



Pi[r,r,S] — Eg 



J2 P{y\X{i,,r))(l)t[r,r,S]{y) 



(59) 



where (f)i[r,r,s]iy) = 1 if there exists {w,r) with r E TZ, {ws.rs) = (ws^vs), and (wfc,rfc) ^ 
{wk,rk)yk to satisfy P{y\x(^^^r)) > e~^^(-''S){y). Otherwise 0i[f,r,5] (?/) = 0. 



19 



For any S2 > and p > 0, we can bound 4'i[r,r,s]{y) by 



(pi[f,r,S]{y) ^ 

This gives, 

Pi[r,r,S] < 

y 



E 



Nf^r,S)(y) 



e p 



S2>0,p>0. (60) 



p{y\x(^,r)y 

■w,{ws,rs)={ws,rs),iwk,rk)¥'{-^k,fk)yk^S 



^Ns2^r-,S){y) 



Piy\X(ii,^r)) 



P{y\X(n,,r))^ 
_w,{'ws,rs)=(ws,rs) 



o^S2T^r.S){y) 



(61) 



Note that we can separate the expectation operators in the last step due to independence between the 
codewords of {w§,r^) and (w§,r^). 

Assume < p < 1. Inequality (|6TI) leads to 



Pi[r,r,S] < Y 



< max Y^os \Ee, \P{y\x^^'y))] {Eo^ [P(2/|a3(^,,))f 1 }%^-2-(^.5)(2/)e^'^S 



r'i^'IZ,r'g=rs y 



jk^S 



■ (62) 



Note that the bound obtained in the last step is no longer a function of r^. 
Step 4: Choosing T(^r,s)iy)- 

In this step, we determine the typicality threshold T(^r,s){y) that optimizes the bounds in (|58l) and (l62l) . 
Define r* ^ TZ as 



r* = argmax Y^Os \P{y\x^^>y))\ {Eo, [P(2/|x(^,,))f 1 e^^2-(..5)(iy)e^'^E.,5'-'= 



(63) 



Given r eTZ, y, and the auxiliary variables si > 0, S2 > 0, < p < 1, we choose T(r,s){y) such that 
the following equality holds. 

Eg^ [Piylx^^^y-^^] e-^^^-(-5)(^) = Ee, [Piy\x^^*,rn)] {Eo, [P(2/|x(^,.))f ] }' e^^-(-^)(^)e^^^^^^''\ 

(64) 

This is always possible since the left hand side of (|64|) decreases in T(^r,s){y) while the right hand side 
of (|64l) increases in T(^r,s)iy)- 
Equation (|64l ) implies 



-N^r,S){y) 



{Eg^[P{y\x^^yy-^^]} 



1 



(65) 



S1+S2 
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Substitute dMI) into ([58]), we get 

Ptir,s] <T.E0s \{Ee, [P{y\x^^,r)y-''']}^' {Eo, }^ 
y '- 

Assume S2 < p. Let si = 1 — ^. Inequality (|66l) becomes 



+ »2 



(66) 



y L 

(67) 

Now do a variable change with p = p^^^^J^p^^^ and s = 1 — -f^jzf^^^ and note that s + p < 1. Inequality 
67l) becomes 

?/ L 

< „^ax_ (5:5: n PxUX,) n Px|.,(X,)P(y|X)^) 



1-s 



N 



(68) 



Following the same derivation, we can see that Pi[r,r,s] is also upper-bounded by the right hand side 
of dM])- Because ([68]) holds for all < p < 1 and < s < 1 - p, we have 



where 



Pt[r,S],Pi[r,r,S]< ^HiaX exp{ - A^^i (5, r , |r , ^*X|r' ) } ) 

r' ^Tt.r g=rs 



Ei{S, r, Px\r, Px\r') = max -p ^ + max_ - log JIII R Px\r, {Xk 



(69) 



Y Xs keS 



s+p 



1-s 



X I E n Pxir,iXk)PiY\X)—^ EH Pxir'SXk)P{Y\X) 

yXg k^S J \Xs k^S 

Finally, substituting (l54l) and (l69l) into (|49l) gives the desired result. 



(70) 



C. Proof of Theorem \3\ 

Proof: We first present in the following lemma an achievable error probability bound for a given 
codeword length A^. 

Lemma 1: Consider fC-user random multiple access communication over a discrete-time memoryless 
channel Py\x- Assume generalized random coding (/^*^^\ 7*^^^) with a finite codeword length and 
gNRm^^ codewords in each codebook. Let the codewords of user k be partitioned into Mk classes, with 
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the i*^ codeword class corresponding to the standard rate interval irj!-_-^^,rj!-]. Assume r^Q < < rj!-^ < 
rk,2--- < ^M4 = ^max- We term {r^i, r^2r ■ ■ , ^fe^M,} the grid rates of user k. For any rate G 
i^ki-i^^ki]^ we define function U{rk) = r^i, which rounds to its grid rate value. Let U{r) be the 
vector version of the U (r) function. Denote as a rate vector whose entries only take grid rate values 
of the corresponding users. Given an operation region TZ strictly contained in an achievable rate region, 
system error probability is upper-bounded by 

meLXren J2sc{1,-,K} J2f^,f'^=U{rs) eXp{-A^ EmiS, f^, Px\r, Px\f,We'R,,U(r)=r^,fs=rs)} 
+ maXr'^'Jiyg=rs exp{ — A^£'j(iS, U{r), Px\r,^re'R.,U{r)=U{r),rs=r'gi Px\r')} 

T{r)=r^ ,rs 



Pp, < max < 



exp{-iV£'j(5,r^, Px\r,'ire'R.,U(r)=rV,rs=r'-,Px\r')} 




(71) 

where exponents ^^(5, r^, Px|r, P x\v,wen,u(v)=rV ,fs=rs) ^^d Ei{S, , Px\r,wen,uir)=rU ,rs=r'^, Px\r') 
are defined by 

Ern{S,r^,Px\r;Px\ryren,U{r)=fU,rs=rs) = -p^^^k + ^aX - log ^ ^ [] ^X|rfc(^fc) 

°<''^^ k^s °<'^' Y xs kes 

Y: n Px\r,{X,)P{Y\Xy-'] min [] 

^Xgfc^S / ren,U {r)=r'^ ,rs=rs, \Xsk^S 

Ei{S,r^,Px\r,Vren,uir)=rU,rs=r',Px\r') = max ^ + max -log^JI n Px\r,{Xk) 

^-^"^^ HS ^<-<^'P YXskis 

T.\{Px\r'SXk)P{Y\X)\ min , E 11 ^x|.jX,)P(y|X)^ . (72) 

■ 

The proof of Lemma [H is given in Appendix |Dl 

We will now prove Theorem [3] based on Lemma [TJ Let the sequence of generalized random coding 
schemes {{C^'^\^^^^)} follow asymptotic input distribution Px\r- Given a finite codeword length A^, 
the input distribution of (Z^^^-*, 7*^^^) is denoted by -Px|w(^'- We assume convergence on the sequence 
of input distributions to its asymptotic limit Px\r is uniforni^. 

Assume for each user, say user k, we partition its codewords into classes, as described in Lemma 
[B The z*^ codeword class corresponding to standard rate interval {r^i^i^f^ii- Assume r^Q < < r^^ < 
rk^2 ■ ■ ■ ^ '^fc^Mfc = ^max- For any rate G (r^j_i, r^J, we define function [/(r^) = r^^, which rounds 
to its grid rate. Let U{r) be the vector version of the U (r^) function. Denote as a rate vector whose 
entries only take grid rate values of the corresponding users. Given a finite codeword length N, and the 
operation region TZ, system error probability is upper-bounded by (TtTI) given in Lemma [T] Let us regard 

'"Note that {P xiW'-">^ ^ deterministic sequence. 
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the codebook partitioning as a rate partitioning, specified by r]^Q < < r|^^ < r^^ ' ' ' < ''^k,Mk ^ -^max 
for user k, V/c. If we fix the rate partitioning and take the codeword length to infinity, we can lower-bound 
the system error exponent as 

I niin5c{i,---,i^}min^g7^j;c/ i?m(5,f^,Px|r,-Px|f,Vre7j,t/(f)=f'^,fs=rs)i 

[ min5c{l,-,/i:} min^i^T^^rL/ Ei{S, r^, -Px|r,Vre7^,t/(r)=r'^,r5=r5 , Px\r) J 

where ^^(5, r^, Px|r, ^'x|f,VrG7^,^7{f)=r^^,f5=rs) and Ei{S,r^ ,Px\r,^r&n,u{r)=rU ,rs=rs^Px\r) arc de- 
fined in (l72l) . 

Define 5 as the maximum width of the rate intervals. 

5 = max rP, — rP, , (74) 

k&{l,-,K},t&{l,-Mk} ' 

Because (|73] ) holds for any arbitrary rate partitioning, if we first take codeword length to infinity, 
and then slowly revise the rate partitioning by taking 6 to zero (which means for all k are taking 
to infinity), and make sure all input distributions within each rate class converge uniformly to a single 
asymptotic distribution, then (l73l) implies (flTI) . Note that the action of "slowly taking 6 to zero" is valid 
since rate partitioning is only used as a tool for error exponent bound derivation. Revision on the rate 
partitioning does not require any change to the encoding and decoding schemes. The requirement that all 
input distributions within each rate class should converge uniformly as 6 is taken to zero is also valid 
since the asymptotic input distribution function of each user is only discontinuous at a finite number of 
rate points. ■ 

D. Proof of Lemma [7] 

Proof: Since the codewords in each codebook are partitioned into classes, we will prove Lemma [U 
by following steps similar to the proof of Theorem [2l with revisions on the bounding details due to the 
fact that input distributions corresponding to codewords within each class can be different. We will not 
repeat the proof of Theorem [21 but only explain the necessary revisions. Throughout the proof, whenever 
we talk about a message and rate pair {W , r), we assume r is the standard communication rate of W. 
We assume a similar decoding algorithm as given in (|45l) . with the second condition being revised to 

C2R: - ^logPr{y\x^w,r)} <nrs,u{rs))(y)- C^^) 

In other words, we assume the typicality threshold T(rs,u(r^))iy) is a function of the standard rates for 
users in S and a function of the grid rates for users not in S. 

Given a user subset 5 C {1, ■ ■ ■ , K}, we define the following three probability terms. 

First, assume {W, r) is the transmitted message and rate pair with r E TZ. We define ^.u as 
the probability that the receiver finds another codeword and rate pair (W^,r) with r E TZ, U{f) = r^. 
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(Ws^f's) = (Ws.rs), and {Wk,rk) ^ {Wk,rk),yk ^ S, that has a likelihood value no worse than the 
transmitted codeword. That is 



{W, r),ren, U{r) = f^, {Ws, rs) = {Ws, rs), {Wk, h) + (M^fc, r^), VA; ^ S. (76) 



Second, assume (VF, r) is the transmitted message and rate pair with r E TZ. We define Pt[r.s] as in 
(|47]) except the typicality threshold is replaced by T(^rs,u{rs)){y)- 

Third, assume (W, r) is the transmitted message and rate pair with r ^ TZ. We define Piir^r^^s] 
the probability that the receiver finds another codeword and rate pair (W, r) with r E TZ, U{r) = r^, 
iWs,rs) = iWs,rs), and (VFfc,rfc) 7^ {Wk,fk),Wk S, that has a likelihood value above the required 
threshold T(^fg^r^){y)- That is 



Pi[r,rU,S] = Pr ^P{y\x^w,r)) > 6 

{W, r),rETZ, U{r) = r^, {Ws, rs) = {Ws, rs), {W^, r^) ^ {W^, h),^k ^ 5. (77) 



Pp, < max 



(78) 



With the probability definitions, we can upper bound the system error probability Pes by 

maXr^Tl J2sc{l, -,K} Y.rV ^r%=U{rs) Pi[r,rU ,S\ 

We will then follow similar steps as in the proof of Theorem [2] to upper bound each of the probability 
terms on the right hand side of (1781) . 

To upper bound Pm[r,r^ ,s]' assume 0<p<l,0<s<l, and get from (|53l) that 



Ea 



P{y\x^w^r) 



E 



Ea 



P{y\X(W,r))~' 



W,{Ws,rs)={^S,rs),U(r)=r^ 



Ee^ P{y\x(w,T))^ ' 



max Eq 



P{y\^{W,r)/ 



< exp{-A^^„(5, r , Px\r, Px\ryren,U(,r)=rU,rs=rs)}^ 

where Em{S,r^ , Px\r, Px\f,we'R.,u{f)=r",rs=rs) is defined in 
To upper bound Ptir,s], we get from (l58l) for si > that 



(79) 



Pt[r,s] < E^0s \Ee, \P{y\x^w,r))'''' 



-^«lT(T.3,t/(r-^))(2/) 



(80) 
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To upper bound Pj[f. ,,(7 5], we get from (|62l) for S2 > and < p < 1 that 



Pi[r,rU,S] < X! ^^S 

y 

Xe 



E 



^(l/|a:;(w,r)) 



(W,r),r5=f5,f7(r^)=r^ 



<j:Ees 
y 



max Ee^ 

^{W,r),rs=rs,U{r^)=r'^ 



Piy\X(^W,r)) ^ 



< , max _ ^ 



Ee^ 



P{y\x[w'y)) 



max Ee^ 



P{y\X{W,r)) ' 



xe 



(81) 



Next, by following a derivation similar to Step 4 in the proof of Theorem [2l we can optimize (l80l) and 



8TI) jointly over T(^^^c/)(y) to obtain the desired result. 
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